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SYSTEM AND METHOD FOR INCIDENT REPORTING, INFORMATION 
GATHERING, RECONSTRUCTING AND ALERTING 

FIELD OF THE INVENTION 

The present invention relates generally to the field of wireless communication 
5 devices having media sensor, such as cameras and microphones. In particular, the 
present invention relates to wireless communication devices that are capable of 
collecting media information, i.e., images, video and/or audio, about an incident so 
that data collected about the incident may be utilized at a later date and/or time. 

BACKGROUND OF THE INVENTION 

10 A camera phone, i.e., a cellular phone having a camera attachment or built-in 

camera, provides a unique opportunity for its user. In particular, the combination of a 
camera and a wireless transceiver provides the user the ability to capture images and 
send the images to other cellular phones. Accordingly, users of camera phones have a 
communication advantage over users of cellular phones without cameras. If a law 

15 enforcement officer has a cellular phone capable of receiving and viewing such 
images, the camera phone user may send images relating to a crime incident to the 
law enforcement officer. 

A wireless device user at an incident, such as a crime incident, may not have 
the ability to capture all views as desired. For example, the user may not be situated 
20 at an optimal position relative to the incident and/or may not have the time to capture 
the images as he or she desires, particularly if the user is running to or from the 
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incident. In fact, other device users in the vicinity of the incident may have 
opportunities to capture better views of the incident. Unfortunately, an efficient 
means for coordinating data capture from multiple users is not available. 

There is a need for a system and method that collects data about an incident 
5 from an ad hoc collection of mobile devices. There is also a need for privacy 
safeguards for those devices that share information about the incident, such as 
location or other revealing information. For example, if an incident occurs at or near 
a user of a wireless communication device, the user may attempt to capture data 
relating to the incident and send the data to an incident reporting center using the 
10 device. The user would desire other devices in the vicinity to capture data relating the 
incident as well. However, it would be difficult for the user to identify and contact 
other devices in the vicinity, let alone devices having camera and communication 
capabilities. Even if the user could contact such devices, the users of such devices 
may be reluctant to share information with the originating user. 

15 There is a further need for a system and method that reconstructs an incident 

based on data collected from the ad hoc collection of mobile devices and/or alerting 
users of other mobile devices of the situation caused by the incident. For example, it 
is desirable to alert other device users in the area or path of the incident regarding the 
possibility of involvement. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagrammatic view of various devices associated with a given 
incident in accordance with the present invention. 

FIG. 2 is a block diagram representing exemplary components of each device 
of the embodiment of FIG. 1. 

FIG. 3 is a flow diagram of an operation of an first reporting device in 
accordance with the present invention. 

FIG. 4 is a flow diagram of a procedure that may be called by the operation of 

FIG. 3. 

FIG. 5 is a flow diagram of an operation of a second reporting device in 
accordance with the present invention. 

FIG. 6 is a flow diagram of a procedure that may be called by the operation of 

FIG. 5. 

FIG. 7 is a flow diagram of an operation of a proximity server in accordance 
with the present invention. 

FIG. 8 is a flow diagram of an operation of a central authority in accordance 
with the present invention. 

FIG. 9 is a perspective view of an exemplary incident that may utilize the 
present invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention uses multiple wireless communication devices to send 
information about an incident to an incident reporting center. A short-range 
transmission media, preferably a wireless local area network protocol, is used to 

5 create an ad-hoc network of wireless communication devices for the purpose of 

reporting data pertaining to an incident. The second reporting device may thus cause 
multiple devices to report the incident either to the controlling device for relayed 
transmission to the incident reporting center, or cause other devices to contact the 
incident reporting center directly. A command message from a single device is used 

10 to control the recording mechanisms of other, nearby devices. 

The present invention may also have other capabilities for enhanced operation. 
A command message from a disabled wireless device may be used to enable another 
nearby device to become the focal point of the incident reporting process. Multiple 
media streams, as received at an incident reporting center, may be used to reconstruct 
15 the incident for analysis and for identification of one or more individuals. When an 
incident has been analyzed, an alert with applicable media information may be sent to 
other wireless users in the vicinity or in vicinities that are likely to be affected. 
Selection of target devices for the alert can be determined in a variety of ways, such 
as via a location service. 

20 One aspect is a method for a wireless communication device, such as an first 

reporting device, to provide information about an incident. The device detects an 
activation input of an incident event. The device then scans for one or more remote 
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devices and coordinates collection of data with the one or more remote devices. Next, 
the device records data relating to the subject matter of the incident event. Thereafter, 
the device transmits the recorded data to a designated location. 

Another aspect is a method for a wireless communication device, such as a 
5 second reporting device, to provide information about an incident. The device detects 
a request signal of an incident event from a remote device. The device then receives 
information from the remote device about a designated location. Next, the device 
records data relating to the subject matter of the incident event. Thereafter, the device 
transmits the recorded data to the designated location. 

10 Still another aspect is a method of a central authority for receiving information 

about an incident from one or more remote devices. The central authority receives 
incident information about an incident event from a remote device. The central 
authority then compares the incident information to previously received information 
to identify all or part of the previously received information that relates to the incident 

15 information. The previously received information, or the part that relates to the 
incident information, includes information received from a device other than the 
remote device. Thereafter, the central authority correlates the incident information 
with all or part of the previously received information that relates to the incident 
information. 

20 Yet another aspect is a system for processing information about an incident 

comprising a first wireless communication device, a second wireless communication 
device and a central authority configured to receive data collected by the first and 
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second wireless communication devices relating to an incident. The first wireless 
communication device includes a first short-range transceiver to transmit a request 
signal and a first media sensor to collect data relating to the incident event in response 
to a user activation input. The second wireless communication device includes a 
5 second short-range transceiver to receive the request signal and a second media sensor 
to collect data relating to the incident event in response to the request signal. The 
central authority performs an action in response to receiving the data. 

Referring to FIG. 1, there is provided a system 100 of various devices 
associated with a given incident. Central to the diagram is an incident 102 and an first 

10 reporting device 104 located at or near the incident. When the first reporting device 
104 notices the incident 102, the first reporting device scans for other wireless 
communication devices within the vicinity of the incident and the first reporting 
device. For example, the first reporting device 104 may include and utilize a short- 
range transceiver to identify all wireless communication devices that are within 

15 communication range 106 of the first reporting device. Examples of the protocol used 
by short-range transceivers include, but are not limited to, Bluetooth, IEEE 802.11 
(such as 802.11a, 802.11b and 802.1 Ig), and other types of WLAN protocols. Also, 
the first reporting device 104 may include and utilize a longer-range transceiver to 
receive information about devices within the vicinity 108 of the incident and/or first 

20 reporting device. Examples of the protocol used by longer-range transceivers include, 
but are not limited to cellular-based protocols, such as Analog, CDMA, TDM A, 
GSM, UMTS, WCDMA and their variants. A positioning system may be used by the 
wireless communication devices to provide location information to the first reporting 
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device 104 or to determine whether a particular device is in the vicinity 108. 
Examples of positioning systems include, but are not limited to, a Global Positioning 
System ("GPS") and a wireless signal triangulation system by base stations 110. 

The first reporting device 102 and the other wireless communication devices 
5 include at least one wireless transceiver and at least one sensor. Some wireless 

communication devices may be mobile devices 112, 114, 116 & 118, whereas other 
wireless communication devices may be stationary or fixed devices 120, 122, 124 & 
126, such as surveillance cameras mounted to poles. Mobile devices include, but are 
not limited to, radio phones (including cellular phones), portable computers with 
10 wireless capabilities, wireless personal digital assistants, pagers, and the like. 

It is important to note that not all wireless communication devices within 
communication range 106 or within the vicinity 108 may be able to provide data 
relevant to the incident 102. For example, certain devices may not have a line of sight 
to the incident, may not be within audible distance, and/or may not have a sensor to 
15 capture data. In FIG. 1, wireless communication devices 114, 118, 122 and 126 are 
marked to represent devices that cannot provide relevant information. 

The data collected from the first reporting device 104 and the remaining 
wireless communication devices 1 12, 1 16, 120 & 124 is communicated to an incident 
reporting center 128. The data may be gathered by the first reporting device 104 and 
20 communicated to the incident reporting center 128, gathered by a local server 130 and 
communicated to the incident reporting center, sent directly to the incident reporting 
center by each individual device, or a combination thereof. The data may be 
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communicated to the incident reporting center 128 by any communication media 
available between the device or devices and the incident reporting center, such as 
short-range wireless communication, longer-range wireless communication or 
landline communication. 

5 During operation, the first reporting device 104 transmits or broadcasts a 

request signal to each available wireless communication device, such as devices 1 12, 
1 16, 120 & 124. Each of the available wireless communication devices will collect 
data relating to the incident event in response to receiving the request signal. 
Subsequently, the incident reporting center 128, i.e., central authority, receives the 

10 data collected by the first reporting device 104 and the available wireless 

communication devices, such as device 112, 116, 120 & 124, relating to the incident 
event and performs an action in response to receiving the data. 

Wireless communication devices may have the ability to capture single or 
multiple images. Examples of capturing multiple images include recording a 

15 continuous stream of images of an action event such as a crime, sports play, concert 
or other type of incident. In a multimedia application, the wireless communication 
devices might also capture and store high-quality audio and text/time-date, etc. Data 
captured by the wireless communication devices may be limited by each device's 
storage capacity, so a particular device may only record a fixed duration of a 

20 continuous image scene. Further, the wireless communication devices may capture 
and record a "continuous loop" of data by deleting/overwriting data as new data is 
captured, or deleting/overwriting an entire segment of data when the segment is full. 
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Referring to FIG. 2, there is provided a block diagram representing exemplary 
internal components 200 of each device, such as the first reporting device 104, the 
other devices 1 10-126, the local server 130, and the remote server at the incident 
reporting center 128 shown in FIG. 1. The exemplary embodiment includes one or 
5 more transceivers 202, 204; a processor 206; and a user interface 208 that includes 
output devices 210 and input devices 212. The input devices 212 of the user interface 
include an activation switch 214. 

Each device must have at least one communication transceiver to 
communication with the other devices of the system 100. The first reporting device 

10 104 must have a short-range transceiver 202 for communication with other wireless 
communication devices. The first reporting device 104 may also include a longer- 
range transceiver for direct communication to the incident reporting center 128 or may 
utilize the short-range transceiver for indirect communication to the incident reporting 
center via another wireless communication device or the local server 130. Similar to 

15 the first reporting device 104, other wireless communication device must have a short- 
range transceiver 202 but may or may not have a longer-range transceiver. The local 
server 130 must have a short-range transceiver 202 for communication with the first 
reporting device 104 and the other wireless communication devices as well as a 
second transceiver 204 for communication with the incident reporting center 128. For 

20 the local server, the second transceiver 204 has longer-range communication 

capabilities than the short-range transceiver 202. For example, the second transceiver 
204 may communication via longer-range communication media or wireline link (e.g. 
PSTN connection). The incident reporting center 128 may have any type of 
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communication media for communication with the wireless communication device 
and the local server 130, such as a longer-range transceiver or wireline link. 

To further clarify the functions of the wireless device as represented by the 
internal components 200, upon reception of wireless signals, the internal components 

5 detect communication signals and a transceiver 202, 204 demodulates the 

communication signals to recover incoming information, such as voice and/or data, 
transmitted by the wireless signals. After receiving the incoming information from the 
transceiver 202, 204, the processor 206 formats the incoming information for output to 
the output devices 210. Likewise, for transmission of wireless signals, the processor 

10 206 formats outgoing information and conveys it to the transceiver 202, 204 for 

modulation to communication signals. The transceiver 204 conveys the modulated 
signals to a remote transceiver (not shown). 

The input and output devices 210, 212 of the user interface 208 may include a 
variety of visual, audio and/or motion devices. The output devices 210 may include, 

15 but are not limited to, visual outputs (such as liquid crystal displays and light emitting 
diode indicators), audio outputs (such as speakers, alarms and buzzers), and motion 
outputs (such as vibrating mechanisms). The input devices 212 may include, but are 
not limited to, mechanical inputs (such as keyboards, keypads, selection buttons, touch 
pads, capacitive sensors, motion sensors, and switches), and audio inputs (such as 

20 microphones). The input devices 212 includes an activation switch 214 that may be 
activated by a user when a user desires initiating of the incident reporting function, as 
well as any other function, in accordance with the present invention. 



- 10- 



The internal components 200 of the device further include a memory portion 
216 for storing and retrieving data. The memory portion 216 includes a non- volatile 
memory portion 218 and a volatile memory portion 220. The non-volatile memory 
portion 218 may be used to store operating systems, applications, communication data 

5 and media data. The applications include, but are not limited to, the applications 
described below in reference to FIGs. 3 through 8 for operating a device. The 
communication data includes any information that may be necessary for 
communication with other devices, communication networks and wireline devices. 
The media data includes any information that may be collected by sensors of the 

10 device, such as those sensors described below. The volatile memory portion 220 of 
the memory portion 220 provides a working area for processing data, such as digital 
signal processing of the data collected by the sensors. The processor 206 may perform 
various operations to store, manipulate and retrieve information in the memory portion 
216. The processor 206 is not limited to a single component but represents functions 

15 that may be performed by a single component or multiple cooperative components, 
such as a central processing unit operating in conjunction with a digital signal 
processor and an input/output processor. 

The internal components 200 of the device may further include one or more 
sensors 222. For example, as shown in FIG. 2, the sensors 222 include a video sensor 
20 224, an audio sensor 226 and a location sensor 228. Each sensor 224, 226, 228 may 
have its own sensor controller for operating the sensor, or a general sensor controller 
230 may be used to operating all sensors. The video sensor 224 may collect still 
images, continuous video or both. The audio sensor 226 may be directed to collect 
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certain types of sounds, such as voice, or all sounds received. The location sensor 228 
may be used to determine the position of the device and, thus, a GPS receiver is an 
example of a location sensor. It is to be understood that a single component of the 
device may operate as a component of the user interface 208 and a component of the 
5 sensors 222. For example, a microphone may be a user interface 208 to receive audio 
voice information for a phone call as well as a sensor 222 to receive ambient sounds 
for incident data collection. 

At this point, an example for utilizing the internal components 200 may be 
helpful for understanding the interaction among these components. For example, the 

10 internal components 200 may comply with E-91 1 regulations, and a user may initiate 
an emergency call by activating the activation switch 214 of the user interface 208. 
The trigger of the activation switch 214 may be activation of a "panic button", 
detection of a high stress level of the user, detection of motion by a physical shock 
detector, or the occurrence of bright flashes or loud ambient noises. In response to 

15 receiving an activation signal from the activation switch 214, the processor 206 would 
then upload multimedia data from the incident scene. In particular, the processor 
would instruct one or more sensors 224, 226, 228 and/or the sensor controller 230 to 
collect data and store the collected data in the non-volatile memory portion 218 of the 
memory portion 216. The sensors 222 may provide the collected data to the memory 

20 portion 216 directly or through the processor 206. The processor 206 may also gather 
data previously provided to the memory portion 216 by the sensors 222. In addition 
to finding data collected by its own sensors 222, the processor 206 may also find data 
collected by sensors of other wireless communication devices by sending a request 
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signal via a transceiver 202, 204, The processor 206 may also utilize a transceiver 
202, 204 to transmit collected data to a designated location or destination, such as the 
incident reporting center 128. 

To protect against malicious misuse, the processor 206 may utilize certified 
5 public key methods and store security-related data or "keys" in the memory portion 
216, preferably the non-volatile memory portion 218. The use of certificates may 
provide addition features for each device, such as dictating that any upload, once 
permitted, may be sent to a single destination of the user's choice. For example, a 
user may predetermine that all visual and audio records may only be sent to the 
10 Federal Bureau of Investigation ("FBI"). Subsequently, if the user permits an upload 
of certain records, the FBI would be the sole destination for these records. 

Referring to FIG. 3, there is provided a flow diagram of an incident reporting 
procedure 300 of the first reporting device 104. The first reporting device 104, i.e., 
the triggering or initiating device, has a short-range communication means, such as 

15 Wi-Fi or Bluetooth, to communicate with other wireless communication devices 
within communication range and/or in the vicinity. Upon determination that an 
incident 102 needs to be reported, the first reporting device 104 sends a short-range 
inquiry or request signal requesting that other devices respond. Each of the other 
devices, upon receipt of this request signal, will send a response that contains its 

20 identity ("ID") to the first reporting device 104. Upon receiving one or more 

responses, the first reporting device 104 will be able to identify the potential second 
reporting devices. 
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The incident reporting procedure 300 shown in FIG. 3 is an exemplary 
operation that may be executed by the processor 206, stored in the memory portion 
216, and provide interaction for the other internal components of the first reporting 
device 104. Starting at step 302, the incident reporting procedure 300 of the first 
5 reporting device 104 first determines whether an activation input has been received at 
step 304. For example, an activation input may be a key selection at the user interface 
208 of the first reporting device 104. If an activation input has not been received, 
then the incident reporting procedure 300 terminates at step 328. On the other hand, 
if the activation input is received, then the processor 206 utilizes a transceiver 202 or 

10 204 to scan for potential second reporting devices at step 306. In a short-range 
communication environment, it is expected that there will be a high correlation 
between signal strength and distance. In one embodiment, the first reporting device 
104 may measure signal strengths of received responses and identify those nearby 
devices having the highest signal strengths, thus having the highest likelihood of 

15 providing data relating to the incident 102. 

In another embodiment, the request signal, at step 306, may request that all 
receiving wireless communication device "freeze" their camera feeds for a particular 
time period to prevent incident-related information from being over-written. In yet 
another embodiment, the information gathered from nearby devices at step 306 may 
20 include whether they are camera-enabled. A camera-enabled device may provide 
video or multimedia feed to the first reporting device 104 and/or the incident 
reporting center 128. If a nearby device is not camera-enabled, it may have an audio 
feed to offer. The first reporting device 104 or the incident reporting center 128 may 
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request the audio information, but label it as having a lower priority. Lower priority 
information may, for example, be placed towards the end of a reporting queue. For a 
further embodiment, all second reporting devices may report battery charge status at 
step 306 to further assist the incident reporting function to raise its priority in the 
5 reporting queue so that information is not lost due to a state of low battery charge. 

If the processor 206 discovers one or more potential second reporting devices 
at step 308, then the processor will attempt to obtain security access authorization, for 
example, by utilizing certified public key methods, from each potential second 
reporting device at step 310. If the processor 206 is successful in obtaining the 

10 security access authorization, then the processor coordinates data collected by the first 
reporting device 104 with data collected by each second reporting device at step 312. 
At minimum, the processor 206 associates the data collected from the various sources 
so that a data gathering or reconstruction device or facility may understand that all of 
the data relates to a similar incident. If the processor 206 does not discover any 

15 potential second reporting devices, does not receive security access authorization or 
performs the steps necessary to coordinate data collection, then the processor moves 
on to identify the subject matter of the incident 102 at step 314. 

In one embodiment, the subject matter may be identified based on the 
activation input. For example, the user of the first reporting device 104 may point the 
20 video sensor 224 and/or audio sensor 226 at the incident 102 so that activation at the 
user interface 208 may capture the incident as a still image, video stream, discrete 
sound, audio stream or a multimedia combination thereof. 
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Once the subject matter of the incident 102 is identified, the processor 206 
records current data relating to the subject matter and/or retrieves any previously 
recorded data relating to the subject matter. The current data and the previously 
recorded data may be obtained serially or, as shown in FIG. 3, obtained in parallel. 

5 The processor 206 may obtain current data from the sensors 222 at step 316. The 
processor 206 continues to record the current data until a predetermined time period 
or file size has been recorded, as determined by step 318. Similarly, the processor 
206 may obtain previously recorded data from the memory portion 216 at step 320. 
The processor 206 continues to retrieve the previously recorded data until a 

10 predetermined time period or file size has been retrieved, as determined by step 322. 

After the current data is recorded, the previously recorded data is retrieved or 
both, the processor 206 may send the data to a designated location at step 324. The 
designated location may be a wireless communication device (such as any one of 
devices 1 12 through 126) or the local server 130 that forwards the data to the incident 

15 reporting center 128 or the designated location may be the incident reporting center 
itself. If more data relating to the incident 102 is available from the sensors 222 or is 
required by the incident reporting center 128, then the processor 206 may continue to 
record more current data at step 326 and repeat steps 316, 318 and 324. For example, 
the processor 206 may continue to record current data until the user interface 208 of 

20 the first reporting device 104 or the incident reporting center 128 via transceiver 202 
or 204 informs the processor that data is no longer available or needed. Finally, the 
incident reporting procedure 300 terminates at step 328. 
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Referring to FIG. 4, there is provided possible operational details of 
coordination of data collection of the incident 102 at step 312 of FIG. 3. The 
processor 206 may perform one or more of these steps to identify the subject matter of 
the incident 102. For one embodiment, the processor 206 may determine the location 

5 of the first reporting device using a location sensor 228 at step 402. For example, the 
processor 206 may determine a location of the first reporting device 104 and, being 
near the incident 102, the location of the first reporting device may serve at the 
location of the incident. The calculated location of the incident 102 is provided to 
other wireless communication devices via transceiver 202 or 204. To further enhance 

10 the determination of the incident location, the processor 206 may receive data from 
the sensors 222 to determine the distance and direction of the incident relative to the 
first reporting device 104. Based on this differential from the first reporting device 
104, the processor 206 may more accurately determine the location of the incident 
102. The enhanced location of the incident 102 is provided to other wireless 

15 communication devices via transceiver 202 or 204. 

For another embodiment, the processor 206 may use data received from the 
sensors 222. As described above in reference to step 314, the user of the first 
reporting device 104 may point the video sensor 224 and/or audio sensor 226 at the 
incident 102 so that activation at the user interface 208 may capture the incident as a 
20 still image, video stream, discrete sound, audio stream or a multimedia combination 
thereof. Through image and/or sound processing techniques, the processor 206 may 
identify distinct characteristics of the incident 102 at step 404, such as rapidly moving 
objects, high decibel sounds and shapes that match predetermined patterns stored in 



- 17- 



the memory portion 216. The video and/or audio characteristics of the incident 102 
are provided to other wireless communication devices via transceiver 202 or 204. 

For yet another embodiment, the processor 206 may use data received from 
the user interface 208. For example, the processor 206 may receive text messages 

5 from the input devices 212, as provided by a user, which describes the incident 102 at 
step 406. Of course, as explained above, manual input may be used in combination 
with the location information, the video characteristics and/or the audio 
characteristics, to enhance the ability of other wireless communication devices to 
identify the subject matter of the incident 102. The manual input from the user 

10 interface 208 relating to the incident 102 is provided to other wireless communication 
devices via transceiver 202 or 204. 

Referring to FIG. 5, there is provided a flow diagram of a responsive reporting 
procedure 500 of the second reporting devices, such as devices 1 12, 1 16, 120 & 124. 
The responsive reporting procedure 500 shown in FIG. 5 is an exemplary operation 

15 that may be executed by the processor 206, stored in the memory portion 216, and 

provide interaction for the other internal components of each second reporting devices 
112, 116, 120, 124. Starting at step 502, the responsive reporting procedure 500 of 
the second reporting devices 112,1 16, 120, 124 determines whether a request signal 
has been received from an first reporting device, such as the first reporting device 

20 104, at step 504. In various embodiments, as describe above, the request signal may 
include other information or commands to enhance the operation or prioritization 
method of the system 100. If a request signal has not been received, then the 
responsive reporting procedure 500 terminates at step 526. On the other hand, if the 
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request signal is received, then the processor 206 will determine whether security 
access authorization, for example, by utilizing certified public key methods, will be 
given to the first reporting device 104 at step 506. If the processor 206 grants security 
access authorization to the first reporting device 104, then the processor proceeds to 
5 identify the subject matter of the incident 102 at step 508, which is describe in more 
detail in reference to FIG. 6 below. 

If the processor 206 is not able to clearly identify the subject matter of the 
incident 102 at step 508 & 510, then the processor may request more information 
from the first reporting device 104 at step 512. In particular, a return signal 

10 requesting more information about the subject matter of the incident 102 is sent to the 
first reporting device 104 via transceiver 202 or 204. If the first reporting device 104 
does not respond with more information, the responsive reporting procedure 500 
terminates at step 526. Otherwise, if more information is received, then the processor 
206 tries again to identify the subject matter of the incident 102 at step 508 & 510. 

15 Requests for more information continue until the processor 206 fails to receive more 
information from the first reporting device 104 or identifies the subject matter of the 
incident 102. Regarding step 506, security access may either be required only once 
when the request signal is initially received or else it may be required every time 
when a signal is received. 

20 Once the subject matter of the incident 102 is identified by the second 

reporting devices 112, 116, 120, 124, the processor 206 records current data relating 
to the subject matter and/or retrieves any previously recorded data relating to the 
subject matter. The current data and the previously recorded data may be obtained 
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serially or, as shown in FIG. 5, obtained in parallel. The processor 206 may obtain 
current data from the sensors 222 at step 514. The processor 206 continues to record 
the current data until a predetermined time period or file size has been recorded, as 
determined by step 516. Similarly, the processor 206 may obtain previously recorded 
5 data from the memory portion 216 at step 518. The processor 206 continues to 

retrieve the previously recorded data until a predetermined time period or file size has 
been retrieved, as determined by step 520. 

After the current data is recorded, the previously recorded data is retrieved or 
both, the processor 206 may send the data to a designated location at step 522. The 

10 designated location may be the first reporting device 104 or the local server 130 that 
forwards the data to the incident reporting center 128 or the designated location may 
be the incident reporting center itself. If more data relating to the incident 102 is 
available from the sensors 222 or is required by the incident reporting center 128, then 
the processor 206 may continue to record more current data at step 524 and repeat 

15 steps 514, 516 and 522. Finally, the responsive reporting procedure 500 terminates at 
step 526. 

Referring to FIG. 6, there is provided possible operational details of request 
signal or information signal reception at step 504 of FIG. 5. The processor 206 may 
perform one or more of these steps to identify the subject matter of the incident 102, 
20 depending upon the information received. For one embodiment, the processor 206 
may receive a location of the first reporting device 104 at step 602. The processor 
206 then determines the location of the second reporting devices 112, 116, 120, 124 
based on data received from the location sensor 228 at step 604. Next, based on the 
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locations of the first reporting device 104 and the second reporting devices 112, 116, 
120, 124, the processor 206 may determine a direction and distance of the incident 
102 relative to the second reporting device at step 606. The processor 206 may then 
instruct the video sensor 224 and/or the audio sensor 226 to be directed towards the 
5 calculated direction and distance, or the processor may instruct the user via the output 
devices 210 to aim the video sensor and/or audio sensor towards the calculated 
direction and distance at step 608. To further enhance the determination of the 
incident location, the processor 206 may receive distance and direction data of the 
incident from the first reporting device 104. 

10 For another embodiment, the processor 206 may use video and/or audio 

characteristics of the incident 102 received from the first reporting device 104 at step 
610. If necessary, the processor 206 may correlate the video and/or audio 
characteristics to a pattern known to the second reporting devices 1 12, 1 16, 120, 124 
at step 612. Step 612 may be necessary when the first reporting device 104 and the 

15 second reporting devices 1 12, 1 16, 120, 124 utilize different criteria for categorizing 
video and/or audio characteristics. The processor 206 may then instruct the video 
sensor 224 and/or the audio sensor 226 to scan the area surrounding the second 
reporting devices 112, 116, 120, 124, or the processor may instruct the user via the 
output devices 210 to scan the area surrounding the second reporting device at step 

20 614. Based on this scanned information, the processor 206 selects the best results to 
direct the sensors 222 at step 616. Accordingly, the sensors 222 are automatically 
directed to the best results or manually directed via the user directed to the best 
results. 
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For yet another embodiment, the processor 206 may receive and display text 
messages, originating from the first reporting device 104, at the output devices 210 of 
the second reporting devices 1 12, 1 16, 120, 124 to the user that describes the incident 
102 at steps 618 and 620. Of course, as explained about, manual input may be used in 
5 combination with the location information, the video characteristics and/or the audio 
characteristics, to enhance the ability of the second reporting devices 112, 116, 120, 
124 to identify the subject matter of the incident 102. 

Referring to FIG. 7, there is provided a flow diagram representing a data 
gathering procedure 700 of the local server 130. Starting at step 702, the processor 

10 206 determines whether incident information is received via a transceiver 202 or 204 
at step 704. If incident information is not received, then the data gathering procedure 
700 terminates at step 720. On the other hand, if incident information is received, 
then the newly received information is stored in the memory portion 216 of the local 
server 130 at step 706. Thereafter, data relating to the subject matter of the incident 

15 102, including the newly received information, is sent to a designated location at step 
714. Preferably, the designated location is the incident reporting center 128. 
Thereafter, the data gathering procedure terminates at step 720. 

The local server 130 may optionally perform additional procedures to enhance 
the operation of the system 100. In one embodiment, the processor 206 of the local 
20 server 130 compares the newly received information with previously received 
information at step 708. The newly received information is received from the 
transceiver 202 or 204, whereas the previously received information is retrieved from 
the memory portion 216. Next, the processor 206 determines whether the newly 
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received information is related to one or more portions of the previously received 
information, i.e., relating to similar incidents, at step 710. If the newly received 
information is related to all or a portion of the previously received information, then 
the processor 206 correlates the new information with the related portion or portions 
5 at step 712. For example, the new information and the related portion or portions may 
be tagged with the same identification code or associated with each other by an index 
or table stored in the memory portion 216. 

In another embodiment, the processor 206 of the local server 130 determines 
whether other information sources are available at step 716. The processor 206 may 

10 receive this information from the first reporting device 104, since the first reporting 
device has already scanned for such devices. In the alternative, the processor 206 
may receive this information from the second reporting devices 1 12, 116, 120, 124 or 
scan for other information sources via one or more transceivers 202, 204 of the local 
server 130. If other information sources are available, then the processor 206 requests 

15 information from the other information sources at step 718 and returns to step 704 to 
await a response to its request. 

Referring to FIG. 8, there is provided a flow diagram representing an incident 
processing procedure 800 of a central authority, such as the incident reporting center 
128. Starting at step 802, the processor 206 of the incident reporting center 128 
20 determines whether incident information is received via a transceiver 202 or 204 at 
step 804. If incident information is not received, then the incident processing 
procedure 800 terminates at step 824. On the other hand, if incident information is 
received, then the newly received information is stored in the memory portion 216 of 
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the incident reporting center at step 806. Thereafter, data relating to the subject 
matter of the incident 102, including the newly received information, is analyzed to 
reconstruct the incident 102 at step 818. 

By reconstructing the incident 102, the processor 206 may draw various 
5 conclusions about the incident, such as what caused the incident and what parties 
were involved. Next, the processor 206 may identify other devices that may be 
affected by the incident at step 820. Preferably, the possibly affected devices are 
identified for the incident reporting center 128 by the first reporting device 104, the 
second reporting devices 112, 116, 120, 124 and/or the local server 130. Upon 

10 identifying the possibly affected devices, the processor 206 sends an alert about the 
situation to any device that may be affected by the incident at step 822. The incident 
reporting center 128 may send the alert via the wireless communication devices 104, 
112, 116, 120, 124, via the local server 130, and/or directly from the incident 
reporting center. Thereafter, the incident processing procedure 800 terminates at step 

15 824. 

If the incident might affect others in the immediate area or in another area, the 
incident reporting center 128 may determine the devices in that vicinity via the 
network operator or via a short-range communication media and alert one or more 
devices of the impending situation. At a minimum, this could be a text message such 
20 as "suspicious activity on Red Line Subway Train Northbound vicinity of Belmont 
Ave." For example, if the situation occurred on Chicago's Red Line near Belmont 
Avenue, the warning might be sent to subscribers located near the Red Line tracks 
and Belmont Avenue, as well as subscribers on Red Line trains and platforms. If 
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there is reason to believe that an individual has perpetrated an offense, the alert may 
include a composite visual image of the person or persons. The composite image 
would be the result of computer reconstruction as described above at step 818. 

Similar to the local server 130, the incident reporting center 128 may 
5 optionally perform additional procedures to enhance the operation of the system 100. 
In one embodiment, the processor 206 of the incident reporting center 128 compares 
the newly received information with previously received information at step 808. 
Next, the processor 206 determines whether the newly received information is related 
to one or more portions of the previously received information, i.e., relating to similar 
10 incidents, at step 810. If the newly received information is related to all or a portion 
of the previously received information, then the processor 206 correlates the new 
information with the related portion or portions at step 812. 

In another embodiment, once the incident reporting center 128 receives an 
incident report message and the identifications of devices near the incident 102, the 

15 incident reporting center may request the nearby devices to upload the contents of 

their data collections, preferably starting with the most nearby devices. The processor 
206 of the incident reporting center 128 may determine whether other information 
sources are available at step 814. The processor 206 may receive this information 
from the first reporting device 104, the second reporting devices 112, 1 16, 120, 124 or 

20 the local server 130. If other information sources are available, then the processor 

206 requests information from the other information sources at step 816 and returns to 
step 804 to await a response to its request. Once the incident reporting center 128 
determines the availability of information sources, a request is sent to members of the 
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ad-hoc proximity network. In the event that many devices are or were close to the 
incident 102, the request will address nearby devices in the order of decreasing 
distance, based on signal strength reports. An information-reduction algorithm might 
also be applied, such that a limited number of video, audio or multimedia frames is 
5 requested of each device during the initial phase of the data-gathering process. 

The additional contributions from other devices, in addition to the first 
reporting device 104, are helpful for the reconstruction and analysis of the incident 
102. However, in some situations, such as inside a packed subway train or at a 
crowded concert, the number of nearby devices could be quite large, due to the 
10 margin of error in location technology. In a high concentration environment, reliance 
on many devices may present an overwhelming amount of data to the dispatcher, and 
much of the reported data might be uncorrected to the incident. Accordingly, it may 
be helpful to provide filtering schemes at the point of data gathering, whether it is the 
first reporting device 104, the local server 130 or the incident reporting center 128. 

15 When a sufficient number of images and other media have been received from 

the incident scene, computer-aided techniques may be applied to determine the 
specific location, distinguished from background artifacts, as well as to identify 
individuals who appear on the image frames. In some instances, the individuals may 
be matched to known offenders via large database matching techniques. For example, 

20 cross-matching of individuals from frame to frame, particularly from a single video 
sensor, and between nearby devices may be utilized in order to reconstruct the 
dynamics of the incident. 
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An first reporting device 104 may be damaged as a result of the incident 102. 
In such a case, the ad-hoc network may be formed by using another nearby device that 
responds to the short-range communication of the first reporting device 104. For 
example, the first reporting device 104 determines that it cannot successfully 

5 communicate to the incident reporting center 128, by detecting that its transceiver is, 
or transceivers are, defective. Then, the first reporting device 104 requests that the 
nearest device, such as one having the highest short-range signal strength, assume the 
responsibility of reporting the incident. In order to ensure that devices may be trusted, 
identifications and other information could be protected by public-key-based 

10 certificates issued by trusted Certification Authorities ("CAs") using methods such as 
developed by RS A Security Inc. 

Referring to FIG. 9, there is provided a perspective view of an exemplary 
incident that may utilize the present invention. FIG. 9 shows a platform 902 for 
loading and unloading of passengers for commuter railcars 904. For this example, a 

15 perpetrator 906 is committing or has committed a crime at the platform and a criminal 
incident 908 has occurred. Near the location of the incident 908, a witness 910 with a 
wireless communication device, i.e., first reporting device 912, collects video and 
audio data relating to the incident using the first reporting device. The witness 910 
also scans the area and determines that there are six other wireless communication 

20 devices 914, 916, 918, 920, 922, 924 nearby. At the platform 902, there are four 

stationary video cameras 914, 916, 918, 920 monitoring activities at the platform. In 
addition, there is pedestrian carrying a camera phone 922 and a driver of a passing car 
with a camera phone 924 locate below and away from the platform 902. 
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Unfortunately, the camera phones 922, 924 of the pedestrian and the driver are not 
within viewing distance of the incident 908. 

In view of the above exemplary situation, the first reporting device 912 may 
record video and audio information relating from the incident 908 and request the four 

5 stationary video cameras 914, 916, 918, 920 to record video information relating to 
the incident. The first reporting device 912 may also request the camera phone 922 of 
the pedestrian to record video and audio data relating to the incident. The camera 
phone 922 may not record any video information of the incident, but may record 
audio information of the incident and may possibly obtain video footage of the 

10 perpetrator 906. 

Also, in this exemplary situation, there is a cellular base station 926 and a 
local server 928 located nearby. Thus, each of the wireless communication devices 
may contact the incident reporting center (not shown in FIG. 9) directly via the 
cellular network represented by the cellular base station 926, or indirectly via a short- 
15 range communication media to the local server 928. It should be noted that, if any 
particular device is not able to send relevant data to the incident reporting center soon 
after the occurrence of the incident, the device may store the data in its memory 
portion until such time when the data may be delivered to the incident reporting 
center. 

20 While the preferred embodiments of the invention have been illustrated and 

described, it is to be understood that the invention is not so limited. Numerous 
modifications, changes, variations, substitutions and equivalents will occur to those 
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skilled in the art without departing from the spirit and scope of the present invention 
as defined by the appended claims. 
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